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ABSTRACT 

Experienced  pilots  with  no  prior 
air-to-surface  training  practiced  a  30 
degree  dive  bombing  task  in  the  T-37 
cockpit  of  the  Advanced  Simulator  for  Pilot 
Training  (ASPT)  located  at  the  Air  Force 
Human  Resources  Laboratory,  Flying  Traininq 
Division,  Williams  AFB,  Arizona.  Use  of  a 
bomb  impact  predictor  cue  by  one  group  of 
^bjects  produced  no  better  performance 
than  that  of  a  second  group  which  practiced 
without  the  cue.  Abrupt  removal  of  the 
cue,  which  during  training  was  not  made 
contingent  upon  performance,  produced  a 
significant  disruption  of  performance  on 
the  bombing  task,  both  in  terms  of  accuracy 
and  in  terms  of  variability  of 
performance.  Best  performance  was  obtained 
by  a  third  group  for  which  the  gunsight 
itself  was  initially  withheld  in  training 
The  results  are  discussed  in  terms  of  the 
need  in  future  systems  for  more  active 
control  over  the  stimuli  controlling  flyino 
performance  as  well  as  the  need  for 
research  into  strategies  for  making  changes 
in  the  pilots  environment  contingent  upon 
performance. 

INTRODUCTION 

A  basic  assumption  of  adaptive 
training  is  that  a  difficult  task  can  be 
learned  more  efficiently  if  it  is  presented 
throughout  training  at  a  level  of 
difficulty  that  is  matched  to  the 
individual's  current  ability  to  perform  the 
task.  Traditional  approaches  have  souqht 
to  control  task  difficulty  through  the 
manipulation  of  the  response  characteris¬ 
tics  of  the  task,  e.g.,  Gaines,  (1967); 
Norman,  Lowes,  and  Matheny,  (1972). 


In  some  instances,  attempts  have  been 
made  to  modify  the  difficulty  of  a  complex 
s.k11?  task  by  providing  augmented 
feedback  to  the  performer,  L intern  (1977) 
and  Lintern  and  Roscoe  (1978),  for  example, 
showed  that  the  use  of  an  "off  course" 
augmented  cue  could  be  used  to  enhance  the 
landing  training  of  naive  students. 


ma  .  in  th5  present  study.  an  attempt  was 
made  to  reduce  the  difficulty  of  an  air-to- 
weapons  delivery  task  in  one  case 
through  the  addition  of  a  visual  bomb 
impact  predictor  cue  and  in  a  second  case 
through  selective  introduction  of  a 
dominant  visual  cue  inherent  in  the  task 
itself,  in  neither  case,  was  the 
introduction  or  withdrawal  of  the  cue 
contingent  upon  changes  in  student 
performance.  The  results  of  the  study  are 
discussed  in  terms  of  the  need  in  future 
sytems  for  more  active  operator/instructor 
control  over  the  visual  environment  of  the 
learner  as  well  as  the  need  for  research 

cuing119  W’th  the  adaptive  use  of  augmented 


METHOD 


Subjects 


. _ n .  {wenty"two  T-37  Instructor  Pilots 
(  s)  assigned  to  Williams  AFB,  Arizona 
served  as  subjects.  No  subject  had 
previous  experience  with  air-to-surface 
weapons  delivery.  Their  flying  experience 
both  in  terms  of  T-37  flying  hours  as  well 
as  overall  military  flying  hours  is  given 
in  Table  1. 


TABLE  1 

FLYING  EXPERIENCE 


T-37  Hours 

Group  X_  s.d. 

Standard  642.00  338.93 
Predictor  701.67  297.21 
No  Gunsight  922.00  168.88 


Total  Hours 
_X  s.d. 

1580.32  1185.86 
1150.17  720.93 

1158.00  152.30 


Overall  721.91  306.86  1367.02  919.50 

Instructors  for  the  bombing  task  were 
Instructor  Pilots  assigned  to  AFHRL’s 
Flying  Training  Division  at  Williams  AFB. 
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All  were  familiar  with  the  air-to-surface 
task  being  taught.  None  were  considered, 
however,  as  "TAC-qualif ied"  instructors. 
Because  of  constraints  on  the  use  of 
instructors,  no  attempt  was  made  to 
counterbalance  instructors  across 
conditions. 

Apparatus 

The  Advanced  Simulator  for  Pilot 
Training  (ASPT)  located  at  AFHRL/FT  was 
used  for  training  of  the  air-to-surface 
task.  Technical  references  for  this  device 
are  found  in  Gum,  Albery,  and  Basinger 
(1975)  and  in  Rust  (1975).  For  the  study, 
the  g-seat  was  inflated  but  not  otherwise 
operational.  Neither  was  the  motion 
platform  in  operation.  The  computer 
generated  visual  scene  was  presented  via 
ASPT's  seven  36-inch  monochromatic 
cathode-ray  tubes  placed  around  the  cockpit 
giving  the  pilot  +110  degrees  to  -40 
degrees  vertical  cuing  and  +  150  degrees  of 
horizontal  cueing.  Conf i guration  of  the 
visual  scene  for  this  study  included  a 
conventional  gunnery  range  visual  data  base 
similar  to  that  developed  for  project  2235 
and  that  used  by  Gray  and  Fuller  (1977)  as 
well  as  a  depressible  bombing  sight  (A-37 
Optical  Sight  Unit).  The  aerodynamic 
mathematical  models  driving  the  simulator 
were  those  of  the  T-37  aircraft. 

The  predictor  cue  used  in  the  present 
study  consisted  of  a  hexagonal-shaped  spot 
of  light,  approximately  30  feet  (9.114 
meters)  in  diameter,  which  appeared  from 
the  air  to  move  along  the  ground,  giving  a 
continuous  indication  to  the  pilot  of  where 
a  bomb  would  impact  if  dropped  at  that 
point  in  time.  The  manner  in  which  the  cue 
was  generated  by  the  system  and  other 
details  of  its  implementation  are  described 
by  Cyrus,  Templeton,  and  McHugh  (in 
press).  The  cue  was  programmed  so  as  to  be 
available  under  command  of  the  console 
instructor.  In  the  present  study,  the  cue 
was  illuminated  continuously.  No  provision 
was  made  by  the  system  to  systematically 
vary  the  intensity  of  the  cue. 

Procedure 

Individuals  in  each  of  three  separate 
groups  (referred  to  hereafter  as  Standard 
Group,  Predictor  Group,  and  No-Gunsight 
Group)  of  T-37  Instructor  Pilots  (IPs) 
performed  15  repetitions  of  a  30  degree 
dive  bomb  task  in  the  T-37  cockpit  of  the 
Advanced  Simulator  for  Pilot  Training 
(ASPT).  Prior  to  entering  the  simulator, 
each  subject  completed  a  short  paper  and 


pencil  pretraining  exercise  intended  to 
familiarize  the  subject  with  the  basic 
elements  of  the  task.  Once  the  subject 
entered  the  simulator,  the  subject  was 
presented  a  recorded  demonstration  of  a  30 
degree  dive  bomb  task.  For  the  predictor 
group,  the  demonstration  contained  the 
predictor  cue  in  addition  to  the  gunsight. 
For  the  no  gunsight  group,  the 
demonstration  contained  neither  the 
gunsight  nor  the  predictor  cue.  For  the 
standard  group,  the  demonstration  contained 
the  gunsight  but  not  the  predictor.  The 
narrative  content  of  the  demonstration  was 
provided  by  an  instructor  pilot  seated  in 
the  T-37  cockpit  beside  the  subject. 
Following  presentation  of  the  recorded 
demonstration,  the  instructor  exited  the 
cockpit  and  all  further  instruction  was 
accomplished  from  the  instructor/operator 
console.  The  only  exception  to  this 
procedure  was  for  the  no  gunsight  group^ 
where  in  order  to  familiarize  the  subject 
with  the  use  of  the  gunsight,  a  second 
demonstration  (this  time  with  gunsight)  was 
presented  between  trials  5  and  6. 

All  groups  performed  15  trials  without 
interruption.  For  the  Standard  Group,  all 
15  trials  were  performed  with  the  gunsight, 
but  not  with  the  predictor  cue  present. 

For  the  predictor  group,  the  predictor  cue 
was  continuously  present  during  all  15 
trials.  For  the  No  Gunsight  group,  the 
predictor  cue  was  never  available.  For  the 
first  five  trials,  the  gunsight  was  not 
available  either.  For  the  No  Gunsight 
group,  the  gunsight  was  introduced  on  trial 
6  and  was  present  for  all  remaining  trials. 

Instructors  seated  at  the  console  were 
given  a  planar  view  of  the  ground  track  and 
final  leg  segment  of  the  maneuver  as  well 
as  a  graphic  display  of  the  bomb  circle  and 
impact  point  with  indications  of  the 
following  release  parameters  (airspeed, 
heading,  altitude,  dive  angle,  g-load).  No 
restrictions  or  specific  instructions  were 
given  to  the  instructor  as  to  the  manner  in 
which  this  information  should  be  used. 

Following  the  15th  trial,  subjects 
exited  the  simulator  for  a  short  break  and 
final  critique  by  the  instructor  prior  to 
reentering  the  cockpit  for  the  10  final 
trials  which  were  conducted  in  the  absence 
of  any  instructor  feedback.  For  the  final 
10  trials,  subjects  in  all  three  groups 
performed  under  the  same  conditions  (i.e.» 
gunsight,  no  predictor  cue,  and  no 
instructor  feedback).  Dependent  measures 
collected  consisted  of  circular  error  and 
release  parameters. 
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RESULTS 


The  results  of  the  present  study  will 
be  presented  in  three  sections.  The  first 
section  will  examine  the  relationship  of 
various  measures  of  flying  experience  to 
circular  error  measures  of  bombing 
performance.  The  second  section  will 
present  differences  between  treatment 
groups  in  terms  of  measures  of  circular 
error.  The  third  section  will  present 
differences  between  treatment  groups  in 
terms  of  release  parameters. 

Measures  of  Flying  Experience  and  Bombing 

Performance 

Prior  to  comparing  treatment  groups  in 
terms  of  bombing  performances,  groups  were 
compared  for  possible  significant 
differences  in  flying  experience.  Neither 
of  three  different  measures  of  performance 
were  found  to  be  significantly  different. 
Groups  did  not  differ  in  terms  of  total 
flying  hours  (F(2, 19)=0.5676,  p>  .05);  T-37 
flying  hours  (F(2, 19)=3. 30332,  p>  .05);  or 
the  ratio  of  T-37  to  total  flying  hours 
(F(2, 1 9 )  =  1 .35116,  p>.05).  With  one 
exception,  none  of  the  above  measures  of 
flying  experience  was  found  to  be 
correlated  significantly  with  bombing 
performance,  when  bombing  performance  was 
taken  as  the  mean  circular  error  over 
trials  20-25.  The  one  exception  was  for 
the  predictor  group,  where  the  ratio  of 
T-37  to  total  flying  time  was  found  to  be 
significantly  correlated  with  circular 
error  (r=-.9165,  df=4,  p  <.05)  for  trials 
20-25.  Comparisons,  however,  between  this 
measure  of  flying  experience  for  subjects 
in  the  predictor  group  with  performances 
over  Blocks  B1-B3  did  not  reveal  the 
presence  of  a  significant  relationship. 

Thus,  despite  the  wide  range  of  flying 
experience  represented  across  the  three 
subject  groups,  the  results  indicate  that 
the  experience  variable  was  not 
systematical ly  related  to  performances  in 
the  present  study. 

Differences  in  Circular  Error  Scores 

The  results  of  primary  concern  deal 
with  the  differences  between  treatment 
groups  in  terms  of  mean  circular  error.  As 
can  be  seen  in  Figure  1,  all  groups  show  a 
significant  decrease  in  circular  error 
scores  over  the  first  15  trials.  Mean 
circular  error  and  standard  deviation  in 
circular  error  by  blocks  of  trials  are 
given  in  Table  2. 


TABLE  2 

MEAN  CIRCULAR  ERROR  (FEET) 


Group 

U  focfcs 

|l  „ 

1-5 

6-10 

11- 

(rta  Is 

16-20 

21-25 

Stand 

(N-ll) 

X* 

s.d.  * 

314.74 

251.99 

227.14 

177.12 

205.22 

129.22 

144.80 

96.25 

192.76 

111.63 

Pred 

(N*6) 

X* 

s.d.  = 

405.13 

247.49 

237.87 

167.42 

212.60 

164.22 

316.67 

172.05 

170.13 

138.63 

No  Gun 

sight 

(N*5) 

X= 

s.d.* 

456.76 

282.86 

152.28 

122.67 

126.60 

83.95 

170.40 

89.68 

167.20 

76.85 

Not  only  was  an  improvement  in 
accuracy  noted  over  the  first  three  blocks 
of  trials,  but  also  a  decrease  in  the 
variability  of  the  bombing  performances  . 
The  difference,  however,  between  circular 
error  scores  for  the  predictor  and 
standard  groups  was  not  found  to  be 
statistically  significant  (F( 1 , 15)=0.363, 
p=.5619).  Neither  was  the  difference 
between  the  standard  group  and  the 
no-gunsight  group  statistically  significant 
(F( 1 , 14)=. 004,  p=.9469).  The  failure  to 
find  a  difference  between  the  standard  and 
no-gunsight  groups  is  probably  accounted 
for  by  the  poor  first  block  performance  of 
the  group  performing  the  task  without  the 
gunsight.  When  a  comparison  is  performed 
between  the  standard  and  no-gunsight  groups 
for  blocks  2  and  3  (i.e.,  trials  6-15),  the 
difference  approaches  statistical 
significance  (F( 1 , 14)=2.528,  p=.1274). 

Discontinuation  of  instructor  feedback 
produced  no  significant  effect  upon 
the  performances  of  the  no-gunsight  and 
standard  groups.  It  must  be  remembered 
that  the  no-gunsight  group  and  the  standard 
group  were  practicing  under  identical 
conditions  for  trials  6-15.  As  is  seen, 
however,  in  Figure  1,  abrupt  removal  of  the 
predictor  cue  produced  an  approximate  50 
percent  decrease  in  accuracy.  This 
decrease  in  accuracy  was  quickly  overcome, 
however,  so  that  by  the  last  block  of  five 
trials,  little  if  any  difference  can  be 
noted  between  the  three  groups.  The 
effect  of  removing  the  predictor  cue  is 
instructive,  inasmuch  as  the  absence  of  any 
difference  between  the  standard  and 
predictor  groups  during  the  first  15  trials 
gives  little  evidence  that  the  cue  was  even 
being  utilized.  The  marked  disruption, 
however,  following  its  removal  gives 
evidence  to  the  contrary. 
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MEAN  CIRCULAR  ERROR  (FEET) 


CONDITIONS 


Figure  1 

Circular  Error  Across  Trials  As  A  Function  Of  Instructional  Conditions 
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Differences  Between  Groups  In  Terms  of 

ke  lease  Karameterr" 

Means  and  standard  deviations  for  each 
of  the  five  release  parameters  are  given  in 
Table  3. 


Standard  and  predictor  cue  groups  were 
found  to  differ  significantly 
(F(l,15)=4.619,  p= . 046 1 )  In  dive  angle 
variability  over  trials  1-15.  While 
circular  error  scores  were  not  found  to 
differ  significantly  over  these  blocks  of 


TABLE  3 

RELEASE  PARAMETERS 
MEANS 


BLOCKS  OF  FIVE  TRIALS 


RELEASE  PARAMETERS 

1-5 

6-10 

11-15 

16-20 

21-25 

s 

349.37 

349.84 

349.70 

346.14 

248.90 

HEADING 

P 

347.03 

348.60 

347.23 

348.23 

333.07 

(350  degrees) 

NS 

349.92 

348.92 

349.12  - 

350.68 

410.00 

ALTITUDE 

S 

3012.95 

2909.58 

2840.92 

2910.65 

2886.32 

P 

2992.37 

2969.99 

2965.83 

2965.07 

2984.70 

(3000'  AGL) 

NS 

2965.48 

2839.64 

2932.43 

2965.43 

3012.99 

G  LOAD 

S 

1.10 

1.18 

1.12 

1.11 

1.20 

P 

1.32 

1.23 

1.28 

1.28 

0.90 

(0.09) 

NS 

1.08 

1.20 

1.18 

1.30 

1.21 

AIRSPEED 

S 

308.59 

308.71 

309.94 

309.25 

308.64 

P 

308.80 

306.40' 

304.87 

307.60 

303.90 

(300  KIAS) 

NS 

309.96 

312.48 

310.24 

311.36 

307.64 

DIVE  ANGLE 

S 

28.00 

29.16 

29.70 

30.11 

29.56 

P 

28.83 

29.00 

27.33 

28.00 

28.03 

(30  degrees) 

NS 

30.12 

29.24 

29.52 

29.12 

27.84 

STANDARD  DEVIATIONS 


RELEASE  PARAMETERS  1-5 


S  3.17 

HEADING  P  2.55 

NS  3.84 

S  311.63 

ALTITUDE  P  283.30 

NS  206.56 

S  0.50 

G  LOAD  P  0.41 

NS  0.39 

S  10.05 

AIRSPEED  P  7.76 

NS  6.34 

S  3.27 

DIVE  ANGLE  P  4.85 

NS  3.11 


BLOCKS  OF  FIVE  TRIALS 


6-10 

11-15 

16-20 

21-25 

2.78 

2.39 

6.45 

2.45 

3.12 

4.66 

2.58 

2.25 

1.91 

1.64 

2.02 

1.54 

264.28 

204.79 

149.11 

161.02 

392.65 

283.94 

168.88 

186.86 

151.77 

131.28 

131.17 

136.81 

0.48 

0.31 

0.16 

0.31 

0.35 

0.42 

0.42 

0.28 

0.33 

0.29 

0.22 

0.33 

7.47 

4.77 

6.84 

4.72 

8  93 

9.27 

4.48 

5.30 

4.59 

4.76 

4.76 

3.24 

2.78 

2.21 

2.50 

2.21 

3.23 

3.38 

2.54 

2.11 

2.10 

1.80 

1.39 

1.86 
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trials,  the  predictor  group  showed  as  much 
as  53  percent  more  variability  in  dive 
angle  (block  3)  than  the  standard  group. 
Comparisons  between  the  standard  and 
predictor  groups  for  trials  16-25  when  the 
predictor  cue  was  removed  and  all  subjects 
performed  in  the  absence  of  any  instructor 
feedback  showed  a  tendency  for  mean  dive 
angle  to  be  shallower  for  the  predictor 
group  than  for  the  standard  group.  This 
difference,  however,  was  not  statistically 
significant  (F( 1 , 15)=2.887,  p=.1068).  In 
attempting  to  isolate  from  measures  of 
release  parameters  the  basis  for  the 
disruption  in  accuracy  caused  by  removal  of 
the  predictor  cue,  groups  were  compared 
over  block  B3  and  block  Tl.  The  only 
difference,  in  terms  of  release  parameters, 
that  was  identified  was  a  significantly 
greater  variability  in  g- loading  for  the 
predictor  group  as  compared  to  the  standard 
group  (F(l,15)=4.932,  p=.0402).  While 
g-loading  was  approximately  35  percent  more 
variable  for  the  predictor  group  on  block 
B3,  removal  of  the  predictor  cue  on  block 
Tl  caused  the  variability  in  g-load  for  the 
predictor  group  to  increase  to 
approximately  three  times  that  of  the 
standard  group. 

While  differences  between  the  standard 
group  and  the  no  gunsight  group  were  marked 
in  terms  of  circular  error,  differences  in 
terms  of  release  parameters  were  more 
subtle.  In  fact,  only  one  comparison 
between  the  two  groups  for  trials  1-5 
revealed  a  difference  that  even  approached 
statistical  significance.  This  was  in  the 
case  of  altitude  variation  upon  release 
where  there  was  a  trend  (F( 1 , 14)=2.834, 
p= .11 64 )  toward  greater  variation  in 
altitude  in  the  standard  group  as  compared 
to  the  no  gunsight  group. 

DISCUSSION 

Comparisons  of  performances  in  the 
present  study  with  those  reported  by  Gray 
and  Fuller  (1977)  reveal  an  approximate  30 
foot  difference  in  mean  circular  error  for 
subjects  performing  the  30  degree  task 
under  similar  conditions.  In  light  of  the 
variability  associated  with  individual 
performances  in  the  present  study,  a  30 
foot  difference  would  be  considered  to  have 
occurred  by  chance.  It  must  be  remembered 
too  that  the  Gray  and  Fuller  (1977)  study 
was  conducted  to  demonstrate  the  limits  to 
which  this  type  of  task  could  be  taught  in 
the  simulator  and  in  so  doing  employed 
experienced  instructors  within  the  context 
of  a  developed  syllabus.  The  present  study 
employed  the  air-to-surface  task  because  of 


its  convenience  as  a  benchmark  task  against 
which  alternative  instructional  treatments 
could  be  evaluated.  Therefore,  the  level 
of  performance  attained  was  secondary  to 
the  sensitivity  of  the  task  to  any  main 
effects  in  terms  of  instructional  treatment 
conditions. 

These  data  are  instructive  too  for 
several  reasons.  First,  from  the 
standpoint  of  flying  training  simulation, 
these  data  demonstrate  that  active  control 
over  cues  inherent  in  the  visual 
environment  of  the  student  (in  this  case, 
the  gun  sight  itself)  may  lead  to  better 
performance  than  the  augmentation  of  that 
environment  with  cues  intended  to  "aid"  the 
student  in  performing  a  difficult  task.  In 
the  present  study,  control  over  stimuli  in 
the  student's  visual  environment  proved  to 
be  more  effective  than  attempts  to  alter 
the  difficulty  of  a  complex  tracking  task 
through  augmented  visual  feedback. 

Secondly,  the  present  data  clearly 
showed  that  the  abrupt  removal  of  an 
augmented  visual  cue  (i.e.,  the  predictor 
cue)  can  produce  a  significant  decrease  in 
accuracy  and  an  accompanying  increase  in 
variability  when  no  provision  exists  for 
gradually  fading  out  that  cue.  The  results 
of  the  present  study  clearly  point  out  the 
need  in  future  systems  for  more  active 
control  over  the  stimuli  present  in  the 
training  environment.  .  .  not  only  their 
presence  or  absence,  but  also  their 
discriminabi lity  (e.g.,  intensity,  etc.). 

It  is  clear  too  that  before  such  active 
control  can  be  incorporated  into  adaptive 
approaches  e.g.,  Willi ges  and  Williges, 
(1977),  research  must  address  how  such 
changes  are  most  effectively  made 
contingent  upon  student  performance. 

A  third  point  concerns  the  poor 
perfomance  obtained  from  subjects  using  the 
predictor  cue.  While  the  disruption  in 
performance  upon  removal  of  the  cue  was 
expected,  the  failure  of  the  predictor 
group  to  initially  outperform  the  standard 
group  was  totally  unexpected.  While 
subjects  were  instructed  to  treat  the  cue 
as  an  "aid"  that  after  15  trials  would  be 
removed,  the  evidence  is  clear  from  the 
disruption  that  occurred  on  Block  Tl  that 
the  cue  was  being  used  during  practice  on 
Blocks  B1-B3.  It,  thus,  does  not  appear  to 
be  the  case  that  the  instructions  biased 
subjects  in  the  direction  of  not  using  the 
cue.  It  may  be  that  although  such  a  cue  may 
serve  to  facilitate  the  performance  of  the 
naive  student,  its  use  with  experienced 
pilots  such  as  those  in  the  present  study 
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served  to  increase  rather  than  decrease  the 
difficulty  of  the  air-to-surface  task. 


The  results,  however,  do  not  preclude 
the  potentially  effective  application  of 
such  predictor  cues  with  pilots  of  lesser 
experience.  For  example,  a  visual  cue 
similar  to  that  used  in  the  present  study 
but  instead  depicting  the  "aimpoint"  of  the 
aircraft  (i.e.,  the  point  at  which  the 
aircraft  would  hit  the  ground  given  its 
present  configuration)  might  prove  to  be 
effective  not  only  in  the  bombing  task  but 
in  acquisition  of  the  landing  task  as 
well.  Research  is  continuing  at  the  Air 
Force  Human  Resources  Laboratory's  Flying 
Training  Division  into  different  and  more 
effective  means  of  manipulating  the  visual 
environment  of  the  pilot. 
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